A review of asymptotic convergence forgeneral state space

نویسنده

  • Jeerey S Rosenthal
چکیده

We review notions of small sets,-irreducibility, etc., and present a simple proof of asymptotic convergence of general state space Markov chains to their stationary distributions.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A review of asymptotic convergence for general state space Markov chains

We review notions of small sets, φ-irreducibility, etc., and present a simple proof of asymptotic convergence of general state space Markov chains to their stationary distributions.

متن کامل

GENERALIZED FUZZY VALUED $theta$-Choquet INTEGRALS AND THEIR DOUBLE-NULL ASYMPTOTIC ADDITIVITY

The generalized fuzzy valued $theta$-Choquet integrals will beestablished for the given $mu$-integrable fuzzy valued functionson a general fuzzy measure space, and the convergence theorems ofthis kind of fuzzy valued integral are being discussed.Furthermore, the whole of integrals is regarded as a fuzzy valuedset function on measurable space, the double-null asymptoticadditivity and pseudo-doub...

متن کامل

Strong convergence of modified iterative algorithm for family of asymptotically nonexpansive mappings

In this paper we introduce new modified implicit and explicit algorithms and prove strong convergence of the two algorithms to a common fixed point of a family of uniformly asymptotically regular asymptotically nonexpansive mappings in a real reflexive Banach space  with a uniformly G$hat{a}$teaux differentiable norm. Our result is applicable in $L_{p}(ell_{p})$ spaces, $1 < p

متن کامل

Asymptotic properties of constrained Markov Decision Processes

We present in this paper several asymptotic properties of constrained Markov Decision Processes (MDPs) with a countable state space. We treat both the discounted and the expected average cost, with unbounded cost. We are interested in (1) the convergence of nite horizon MDPs to the innnite horizon MDP, (2) convergence of MDPs with a truncated state space to the problem with innnite state space,...

متن کامل

Asymptotic behavior of a system of two difference equations of exponential form

In this paper, we study the boundedness and persistence of the solutions, the global stability of the unique positive equilibrium point and the rate of convergence of a solution that converges to the equilibrium $E=(bar{x}, bar{y})$ of the system of two difference equations of exponential form: begin{equation*} x_{n+1}=dfrac{a+e^{-(bx_n+cy_n)}}{d+bx_n+cy_n}, y_{n+1}=dfrac{a+e^{-(by_n+cx_n)}}{d+...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1999